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Abstract. Conditions guaranteeing convergence of linear stochastic Volterra 
operators are studied. Necessary and sufficient conditions for mean square 
convergence are established, while almost sure convergence of the linear op- 
erator is shown to imply mean square convergence. Sufficient conditions for 
almost sure convergence of the stochastic linear operator are established. The 
sharpness or necessity of these conditions is explored by means of examples. 



1. Introduction 

This article studies convergence properties of ltd- Volterra integrals of the form 

(Hf)(t) := [ H(t,s)f(s)dB(s) (1.1) 
Jo 

where H is a deterministic Volterra kernel and / is a deterministic function on 
[0,oo). We require certain continuity and regularity properties on H and / which 
simplify our analysis and ensure the existence of Wf for every appropriate /. The 
result we have found of most use is to determine, for fixed sample path, under which 
conditions % takes the space of bounded continuous functions on [0, 00) into the 
space of bounded continuous functions on [0, 00) with a limit at infinity. 

This may be thought of as an analogue of the theory of admissibility of (de- 
terministic) linear continuous Volterra operators, especially in the important case 
where the operator takes BCi (0, cx)) into itself, or when T-L takes BC into BCi. 
Corduneanu has done significant work on the general theory of admissibility for 
Volterra integral operators (see [B] and [7]). One motivation for the development of 
such an admissibility theory in the deterministic case is to give precise asymptotic 
information regarding the solutions of integral, differential and integro-differential 
equations. Corduneanu [8 : contains a comprehensive survey of progress up to 1991, 
while further developments in this theory are due to Cushing, Miller and others. 
More recently, admissibility of continuous linear Volterra operators has been used 
to determine asymptotic behaviour of a nonlinear integrodifferential equation with 
infinite memory in Appleby, Gyori and Reynolds [5] in this journal. Parallel results 
are also available in discrete time: indeed, recent results on the theory of admissi- 
bility of Volterra operators is discrete time, together with applications to Volterra 
summation equations, include Gyori and Reynolds [9] and Song and Baker |15| . 
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Reynolds [T3] has established results which characterise certain admissible pairs 
of spaces, as well as connecting the recent dynamical systems literature with par- 
allel, earlier work in the theory of linear operators. 

Analogous to the deterministic setting, integrals of the form (jl.ip arise in the 
analysis of asymptotic growth rates of solutions of affine stochastic Volterra equa- 
tions. To illustrate we define some notation. For a function x : [— r, oo) — > R, we 
define the segment of x at time t > as the function 

Xt '■ [— t, oo) — > R : x t (u) — x(t + it). 

Consider the affine stochastic functional equation 

dX(t) = L{t,X t )dt + a(t)dB{t), t > 0; X(0) = x e R, (1.2) 

where L is a linear functional and a is a continuous function. The associated 
resolvent equation arises from setting a = 0, giving 

r'(t) = L(t,r t ), t>0; r(0) = 1; r(t) = 0, f < 0. (1.3) 

Providing both (|1.2p and (|1.3p have well-defined solutions then X may be expressed 
in terms of r, i.e. 

X(t)=r(t)x + f r(t- s)a(s)dB(s), i > 0. (1.4) 
Jo 

If one were to scale the solution of (jl.4p by a growing or decaying term then 
stochastic Volterra integrals of the form (jl.ip arise. Establishing results about the 
convergence of these integrals (i.e. the integrals in (jl.ip ) therefore amounts to 
determining very precisely their almost sure asymptotic rates of growth or decay. 
The authors propose to follow this programme of research in later works. Another 
work where the scaled solution of a stochastic integral equation tends to non-trivial 
limit includes Appleby [1 . 

The main results of this article concerning mean square convergence and almost 
sure convergence of (jl.ip are given in Section The proofs of all results are given 
in subsequent sections. 

1.1. Preliminaries. Let R be the set of real numbers. We denote by R + the 
half- line [0,oo). If d is a positive integer, R d is the space of <i-dimensional column 
vectors with real components and K dlXd2 is the space of all di x g?2 real matrices. 

Let BC(R+;R dlXd2 ) denote the space matrices whose elements are bounded 
continuous functions. The abbreviation a.e. stands for almost everywhere. The 
space of continuous and continuously differentiable functions on R + with values 
in K dlXrf2 is denoted by C*(M + ;M dlX<i2 ) and C 1 (R+; R dl xd2 ) respectively. While 
C 1 '°(A;R dlXd2 ) represents the space of functions which are continuously differen- 
tiable in their first argument and continuous in their second argument, over some 
two-dimensional space A. The space of p th — integrable functions is denoted by 

/•OO 

L P (R + ;M) := {/ : R + — S- R : / \f(s)\ p ds < +oo}. 

Jo 

For any vector x £ R d the norm ||-|| denotes the Euclidean norm, ||x|j 2 = 
EjLi \ x j\ 2 - While for matrices, A = (a^/s) G M nxd , we use the Frobenius norm, i.e. 

n d 
i=l k=l 

As both R d and R nxd are finite dimensional Banach spaces all norms are equivalent 
in the sense that for any other norm, || • || , one can find universal constants d\ (n, d) < 
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d-2 (n, d) such that 

di\\A\\ F < \\A\\ <d 2 \\A\\ F . 
Thus there is no loss of generality in using the Euclidean and Frobenius norms, 
which for ease of calculation, are used throughout the proofs of this paper. Moreover 
we remark that the Frobenius norm is a consistent matrix norm, i.e. for any A G 

\\AB\\ F <\\A\\ F \\B\\ F . 
We define the following modes of convergence: 

Definition 1. The Revalued stochastic process {X(t)}t>o converges in mean- 
square to Xoo if 

lim E[\\X(t)-X oo \\ 2 }=0. 

t— >oo 

Definition 2. If there exists a P-null set fio such that for every ui g" the 
following holds 

lim X{t,oS) = Xoo{lS), 

t— >oo 

then we say X converges almost surely (a.s.) to X^. 

2. Stochastic Limit Relation 

2.1. Mean Square Convergence. Let B(t) — {Bi(t), B2(t), Bd{t)} be a vec- 
tor of mutually independent standard Brownian motions. We consider the following 
hypotheses: let A C R 2 be defined by A = {(t, s) : < s < t < +00} and 

H : A -> R nx ™ is continuous. (2.1) 

We first characterise, for / G C([0, 00); R nxd ) with bounded norm, the convergence 
of the stochastic process Xf = {Xf(t) : t > 0} defined by 

X f {t)= f H(t,s)f(s)dB(s), t>0 (2.2) 
Jo 

to a limit as t — ¥ 00 in mean-square. 

Before discussing this convergence, we note that (I2.1[) is sufficient to guaran- 
tee that Xf(t) is a well-defined J rS (i)-adapted random variable for each fixed t. 
Therefore the family of random variables {Xf(t) : t > 0} is well-defined, and Xf 
is indeed a process. Condition (12 . If) also guarantees that E[Xf(t) 2 } < +00 for each 
t > 0. Since / H> Xf is linear, and the family (Xf(i))t>o is Gaussian for each 
fixed /, the limit should also be Gaussian and linear in /, as well as being an 
J rB (oo)-measurable random variable. Therefore, a reasonably general form of the 
limit should be 

p 00 

X* f := / H oc (s)f(s)dB(s), (2.3) 
Jo 

where we would expect to be a function independent of /. In our first main 
result, we show that Xf(t) — ¥ X^ in mean square as t — s- 00 for each /. 

Theorem 3. Suppose that H obeys (|2.1[) . Then the statements 

(A) There exists G C([0, 00); R" x ") such that WH^^f ds < +00 and 

lim / \\H(t,s) - #oo(s)|| 2 ds = 0. (2.4) 

(B) There exists G C*([0, 00); R" x ") such that for each f G BC(R+; R nxd ), 

r* 

Um E / H(t,s)f(s)dB(s)- / H 00 (s)f(s)dB(s) =0 (2.5) 



are equivalent. 
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In the deterministic admissibility theory, the assumptions for convergence are 
given in a different form from (12.41) . c.f. e.g. Theorem A.l from [3]- Our next result 
shows that the natural analogues of those assumptions are equivalent to (12.41) . 



Proposition 1. Suppose that H obeys (|2.1I) . Then the following are equivalent: 

(A) H obeys (H}; 

(B) There exists G C([0, oo); R nxn ) such that 



f* 2 

lim limsup / ||i?(i,s)|| ds = 0, 

T->oo 4-j.oc J T 



(2.6) 



lim / \\H(t,s) - H ao (s)f ds = 0, for every T > 0. (2.7) 

2.2. Necessary Condition for Almost Sure Convergence. We now consider 
the almost sure convergence of Xf(t) as t — > oo to a limit. Our next main result 
shows that if we have convergence in an a.s. sense, we must also have convergence 
in a mean square sense. 

Theorem 4. Suppose that H obeys (|2.1J) and there exists H x e C([0, oo); R" x ") 
such that for each f e BC([0, oo); R nxd ), 

lim / H(t,s)f(s)dB{s) = / dB(«), a.s. (2.8) 

f ^°°Jo Jo 

T/ierc (EU) and (gUJ ftoZd. 

Theorem[3]is concerned with moment behaviour of Xf(t) — J Q H(t, s)f(s) dB(s), 
indeed the continuity of these moments is guaranteed by the assumption (|2.1[) . In 
Theorem^] the condition (|2.8[) may implicitly impose continuity of the sample paths 
of A"/. The issue of continuous sample paths of Xf is addressed in Lemma 2.D. 
of Berger and Mizel [J. Specifically, let H obey (12.11) . Suppose that obeys a 
Holder continuity condition of the following form: there exists a function K(s) and 
a constant a > such that 

/ \K{s)\ 2 ds < +oo 
Jo 

and 

|JJ(* 2 , s) -if(ii,s)| < K(s)(t 2 -h) a , foiQ<s<t 1 <t 2 <T. (2.9) 
Since H is continuous, it follows that there exist constants e > 0, D > such that 



sup / |if(t,s)| 2+e ds< D. 

;e[0,Tl JO 



te[o,r] Jo 

Lemma 2.D. of [3] now guarantees that a continuous version of 

f H(t,s)f(s)dB(s) 
Jo 

exists on [0, T\. 

Remark 1. Therefore we have shown that (|2.4I) is a necessary condition for a.s. 
convergence. It is of course natural to then ask whether (|2.4[) is sufficient. We 
show by a simple example that in general additional conditions are needed in order 
for (|2.8p to hold. It is further noted that the assumed continuity and structure of 
H in Examples [5] and [S] immediately gives the continuity of the sample paths of 
/' H(t, s)f(s)dB(s), and that the sufficient condition (|2.9[) is not needed. 
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Example 5. Suppose that H* : [0,oo) —> R and : [0, oo) — > R are continuous 
functions, and define 

H(t,s) = H oa (s)+H i (t), (t,s)eA. 

Then H is continuous. Suppose also that Hoo E L 2 ([0, oo); K). By Theorem^ it 
follows that 

lim VtH f (t) = (2.10) 



is necessary and sufficient for f|2.5[) . It is also a necessary condition for (|2.8p . If one 
further supposes that H$ obeys 



lim Jtlog logtH^t) = 0, (2.11) 

t— >oo 

then holds. 

Obviously the conditions (|2.1ip and (|2.10l) do not coincide; in fact, (I2.11[) implies 
(I2.10p . This provides an example of the veracity of Theorem @] which can be verified 
independently of the general proof of that result. 

We note also that it is very difficult to relax (|2 . 1 1 1) and still have the integral 
J Q H(t, s)f(s) dB(s) tending to a limit a.s. as t — > oo. Indeed, there exist functions 
H$ which do not obey (I2.11[) , and so must satisfy 



lim sup V< log log t \HHt)\ > 0, 

t— >oo 

for which 



lim / H(t, s) dB(s) exists 



= 0, (2.12) 

while at the same time we still have (|2.5[) . 

A choice of which satisfies these conditions can readily be made. Consider a 
continuous function H " which obeys H " (n) = 1/ ^/nlog log(n + 2) for all integers 
n > 1 but for which y/tH^t) -> as t — > oo and limsup^^ \Jt log \o%t\H^(t)\ < 
+oo. 

The next example shows that sometimes the conditions which give mean square 
convergence and a.s. convergence are the same. 

Example 6. Suppose that H$ : [0, oo) — > R and : [0,oo) — > R are continuous 
functions, and define 

H(t,s) = H oc (s)H\t), (t,s)GA. 

Then H is continuous. Suppose also that £ L 2 ([0, oo); R). Therefore, by 
Theorem [31 we have (|2.5p if and only if 

lim H*(t) = 1. 

t— >oo 

We know by Theorem H] that this condition is also necessary for a.s. convergence. 
Indeed it is also sufficient for (12.81). 



2.3. Sufficient Conditions for Almost Sure Convergence. We now inves- 
tigate sufficient conditions for a.s. convergence for functions H which need not 
necessarily be of the form 

n 

H(t,s) = J2H j (s)Hl(t), (M)eA, 
j'=i 

and which are covered by explicit and direct calculations in Examples [5] and [5] 
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Theorem 7. Suppose that H obeys (JSTTJ and also that H £ C 1 '°(A; R" x "). Sup- 
pose also that there exists Hoo £ C([0, oo); M. nxn ) such that J °° || -ffoo(s)|| 2 ds < +oo 
and 

lim / \\H(t,s)-H 00 {s)\\ 2 ds-\ogt = 0, (2.13) 

t-+ooJ Q 

and 

There exists q > and c 9 > swc/i £/ia£ 

/ ||ffi(M)|| 2 ds<c ? (l+t) 2 *, ||#(M)|| 2 < C(? (l + £) 2 «. (2.14) 
Jo 

TTierc obeys ((2~8j) . 

Remark 2. Condition (|2.13p implies a rate of decay of J* \\H(t,s) — H 00 (s)\\ 2 ds 
to zero as t — > oo. This strengthens the hypothesis (|2.4p which is known, by 
Theorem [4l to be necessary. 

Remark 3. We comment now on the continuity of the sample paths of the process 
J ' H(t, s)f(s)dB(s) in Theorem [7J For simplicity we discuss only the scalar case. 
This continuity of the sample paths is assured by the derivative condition (|2.14l) . 
Fix T > and let < s < t x < t 2 < T. Then, as H £ C 1,0 (A;R), by the Mean 
Value Theorem we get 

\H(t 2 ,s)-H(t 1 ,s)\ = \Hxit*, s^lh-hl, 

for some t* — t*(s) £ [ti,t 2 ]- Next, define K(s) := sup tl<t<t2 \Hi(t,s)\. This is 
well-defined and finite by the continuity of H\. Therefore 

\H(t 2 ,s) -H(ti,s)\ < K(s) \t 2 -h\, for all < s < t x < t 2 < T, 

which is (I2.9[) with a = 1. Note moreover that the continuity of s i-> K(s) ensures 
that 

f \K(s)\ 2 ds < +oo, 
Jo 

and therefore all the conditions of Lemma 2.D. of Berger and Mizel [3] are satisfied. 

Remark 4. While the pointwise bound on \\H{t, t)\\ in (|2.14l) may appear quite mild, 
one may prefer an integral condition to this pointwise bound as this would allow 
\\H(t, t)|| to potentially have "thin spikes" of larger than polynomial order. Scrutiny 
of the proof of Theorem [7] reveals that the condition \\H(t, t)\\ < c q (l + t) 2q can 
be replaced by 

,(fc+i) e 

lim / \\H{s,s)\\ 2 ds • log fc = 0, for < 6 < 1/(1 + 2q), (2.15) 

fc ^°° Jk e 

where the limit is taken through the integers. Nevertheless for simplicity we retain 
the condition on ||i2"(£, t)|| in the statement of Theorem[7J 

Example 8. In light of Examples [5] and [5] (both of whose hypotheses lie outside 
the scope of Theorem [Jj in spite of the conclusion of that theorem still holding) 
one might query the sharpness of (I2.13[) . In fact, a condition of the form (|2.13[) is, 
to some extent, necessary. 

Suppose, for example that H (t, s) = e _ ^* _s - ) CT(s), < s < t, where t \-t a(t) is a 
continuous function. Define the process 

Y(t) = [ H(t,s)dB(s), t > 0. 
Jo 
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Then, in the context of Theorem [3] or [U H oa (s) = 0. Moreover, if Y converges to a 
limit almost surely we note from (|2.8[) that the limit should be zero, and by Thco- 
rem[4l condition (|2.4p must hold. Hence, we must have that lim^oo L H (t, s) 2 ds — 
0. It can be shown that this happens if and only if J. t+ cr(s) 2 ds — > as t — > oo. 



Suppose, moreover, that lim^oo J t+ c(s) 2 ds ■ logi — L e (0, oo]. Then (|2.13[) 
is violated. As Y is the unique adapted process satisfying the stochastic differential 
equation dY{t) = —Y(t) + a(t)dB(t), then it is a consequence of Theorem 4.1 of 
Appleby, Cheng and Rodkina [2] that if L £ (0,oo) then Y is bounded and does 
not tend to a limit or otherwise L = +oo and Y is unbounded, i.e. the conclusion 
of Theorem [7] does not hold. 

Moreover, (|2.13l) may in some sense be regarded as sharp for Y tending to a 
limit. From Theorem 4.1 of [2] it is known that if Y tends to a limit then this 
limit must be zero. In Theorem 4.4 of [2] and the discussion preceding it, it is 
shown when f n cr(s) 2 ds is a decreasing sequence, that Y(t) — > as t — > oo 
a.s. implies f™ +1 <r(s) 2 ds ■ \ogn — > 0. This implies (|2.13p . On the other hand, if 

f n+1 c(s) 2 ds ■ \ogn — > as n — > oo, we have by part (A) of Theorem 4.1 of [2] it 
follows that Y(t) — > as t — > oo a.s. Therefore, in this case, we see that (|2 . 1 3[) is 
necessary and sufficient for convergence. 

If Y is bounded we have that / t ' +1 c(s) 2 ds — > as t — > oo. Therefore imposing 
a polynomial growth bound on a is not restrictive. Under this restriction and the 
condition lim^oo a(t) 2 log t = L £ (0, oo) we have that (|2.13[) is violated but (|2.14[) 
holds. Hence (|2.13[) is chiefly responsible for convergence in this case. 

3. Proofs of Admissibility Results 

The following proofs are given for scalar valued functions. The multi-dimensional 
results may be obtained by considering matrix functions component-wise (in such 
calculations it is often convenient to use the Frobenius norm due to Ito's isometry). 

Remark 5. If (|2.5[) holds, it is implicit that the stochastic integral 

H 00 {s)f(s)dB{s) 







exists for every / S BC((Q, oo); M), and in particular this holds in the case when 
f(s) = 1 for all s > 0. Therefore we have that J H ao (s) dB(s) exists. Therefore, 
by the martingale convergence theorem, we have that Hoo 6 L 2 ((0, oo); M.). 

Proof of Theorem [3J It is not difficult to see using Ito's isometry that 

f rt i-oo 

/ H(t,s)f(s)dB(s)- / H 00 (s)f(s)dB(s) 
\Ja Jo 



2 



)-H 00 (s)\ f(sYds + J H^sYfisYds, (3.1) 

where the independence of the elements of the Brownian vector and of stochastic 
integrals over non-overlapping intervals has been used. 

Firstly we show that (A) implies (B). Now as / € BC([0, oo);R), 

rt poo ~ 

1 I I H(t,s)f(s)dB(s)- H 00 (s)f(s)dB(s) 



( / (H(t,s)-H 00 {s)) 2 ds+ f H^sfds] sup \f(s)\ 2 

JO Jt J s>0 
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Taking the limit as £ — > oo, then by hypothesis both terms on the right-hand side 
of the above inequality tend to zero, and so we obtain (|2.5D . 

Suppose to the contrary that (B) holds. By Remark [5j we have that Hoc £ 
L 2 ([0,oo);R). Rearranging 437Q) with f(s) = 1 for all s > 0, 

J ds 



E 



H(t,s)dB(s) 



/OO 
H^isfds, 



Therefore by the hypothesis of (B), we arrive at 



limsup f (H(t,s) - i?oo(s)) 2 ds = 0, 

t— >oc JO 



as required. 



□ 



Proof of Proposition [TJ We prove that (A) implies (B) first. To prove (|2.6p . 
note for any £ > T we have the estimate 

/ H 2 (t,s)ds = f (H(t,s)~H oc (s)+H QC (s)) 2 ds 
Jt Jt 

<2 f (H(t,s)-H 00 ( S )) 2 ds + 2 f H^sjds. 
Jo Jt 

Since Hoc e £ 2 ([0, oo); R) and (|2.4p holds, we have 

limsup / H 2 (t,s)ds< / H^ > (s)ds. 

Since the lefthand side is monotone in T, we may take the limit as T — > oo on both 
sides, using the fact that i?oo € L 2 ([0, oo);R) to obtain the desired conclusion. 
To show (|2.7p . let T > be arbitrary. Then, for any t >T we have 

(JJ(i,s)-ff 00 (s)) 2 ds< / (H(t,s)-H 00 (s)) 2 ds, 



We 



whence the result letting £ — > oo and applying (|2.4I) . Thus (A) implies (B). 

To prove that (B) implies (A), we first must show that Hoo S i 2 ([0,oo);R 
start by observing that (|2.6[) is nothing other than limT-j.oc L(T) = where 

L(T) :=Hmsup / H(t,s) 2 ds. 

t— >oo jt 1 

Since L is non-increasing, for every e > there exists To(e) > such that L(T) < e 
for all T > T (e). Now, let T > T . Suppose also that £ > T. Then 



/ H 2 OQ {s)ds<2 f (H OQ (s)-H(t,s)) 2 ds + 2 f H(t,s) 2 ds 

J To */ To J To 

<2 f (Hocis)- H(t,s)) 2 ds + 2 [ H{t,s) 2 ds. 
Jo Jt q 



So by (I2.7P we have 



[ T H 2 oo (s)ds<2L(T ), 

J T 



and since the righthand side is independent of T, it follows that £ L 2 ([0, oo); 1 
which is one part of 
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To prove the other part, let t > T > 0. Then we have the estimate 

/ {H(t, S )-H oc {s)) 2 ds 
Jo 

= [ (H(t,s)~H QO (s)) 2 d S + [ {H(t,s)-H 00 {s)fds 
Jo Jt 

< [ (H(t 7 s)~ H oc {s)) 2 ds + 2 ( H{t,s) 2 ds + 2 [ H^sf ds. 
Jo Jt Jt 

Since e L 2 ([0, oo);R) and H obeys (|2.7[) . we have 

lim sup / (H(t,s) - 7?oo(s)) 2 ds < 2 lim sup / H(t,s) 2 ds + 2 Hods) 2 ds. 
t— too Jo t— >oo Jt Jt 

Now letting T->ooon both sides of the inequality and using (|2.6p proves the other 

part of flU]) □ 

Proof of Theorem |4j Suppose for a moment that f(s) = 1 for all s > 0. Then 
by (|2.8[) it follows that J Q Hoo(s) dB(s) exists. Therefore, by the martingale con- 
vergence theorem, we have that Hoo £ L 2 ([0, oo); R), which is one part of (|2.5p . 
Therefore, for / e SC([0, oo); R) the processes X f and Xf in and (gjj are 
well-defined. Also, as € L 2 ([0, oo); R), wc have that X*j is well-defined, and 
thus Xf(t) — > Xf as t — !• oo a.s., where 



/•OO 

x;(t) = / HMdBis) 

Jo 



Next, define F/(i) := X f (t)-Xf(t) for t > 0. Evidently, we have that E[Y f (t)} = 
for all t > 0. Also, we have from (|2.8p that X/(£) — > X| as f — > oo a.s. Therefore 

lim Y f (t) = lim - (t)} = lim - X* f + X* - Xf{t)} = 0, 

almost surely. Notice also that (Yf(t)) t >o is a Gaussian process. Since it con- 
verges a.s., it does so to a Gaussian random variable which has zero mean and 
zero variance, and by the argument of pp304-305 in Shiryaev [13] . we have that 
Var[l}(i)] ->• as t oo. Since E[Y f (i)] = 0, we also have EfY^t)] -> as t -)• oo. 
However, by Ito's isometry, 

E[F/(t)] = E [(X f (t) - Xf (i)) 2 ] = f{H{t, S )-H O0 {s)) 2 f 2 {s)ds. 

Jo 

Therefore we have 



lim / (H(t,s)-H oo (s)) 2 f 2 (s)ds = 0, 

t-HX>J Q 



and choosing f(s) = 1 for all s > 0, we arrive at the rest of (|2.4j) . Clearly 
now holds by virtue of Theorem [3] □ 

4. Proof of Theorem [7] 
Define H = H - Hoo. Notice that Hoo € L 2 ([0, oo); R) implies that 

lim / H oo (s)f(s)dB{s)=0, a.s. 

so that proving 

lim / H(t,s)f(s)dB(s) = 0, a.s. (4.1) 
is equivalent to establishing 
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Since H £ C 1 ' , we have Hi = H\. Therefore, we have 



X f {t):= J H(t,s)f(s)dB(s) = J ^H(s,s)f( S )+ J H^u, s)f(s) du j dB(s) 
By a stochastic Fubini theorem, jTTJ Theorem 4.6.64, pp. 210-211], we have 



X f (t) = / H(s,s)f(s)dB(s) 



H 1 (u,s)f{s)dB(s) du. 



10 \J0 

Now, let (tn)n>o be an increasing sequence with to — and t n — > oo as n — > oo. In 
fact, choose 

t n = n e , for some 9 £ (0,1/(1 + q) A 1/(1 + 2q)) C (0,1), (4.2) 

where q is the number in (|2.14p . 

Therefore for t £ [t n ,t n +i), we have 

X f (t)=X f (t n )+ f H(s,s)f(s)dB(s)- f ff 00 (s)/(s)rfS(s) 



tn 



H 1 (u,s)f(s)dB(s) du 



Hence 



sup \Xf(t)\<\X f (t n )\+ sup 
t n <t<t n+1 t n <t<t„ +1 



Hoo(s)f{s) dB(s) 



+ sup 

t n <t<t„ 



H(s,s)f(s)dB(s) 



t„+i 



tn 



H 1 (u,s)f(s) dB{s) 



du. (4.3) 



We now show that each of the four terms on the righthand side of (|4.3[) tends to 
zero as n — >■ oo a.s. 

STEP 1: First term on the righthand side of (|4.3[) . First we prove that 



lim Xf(t n ) = 0, a.s. 



(4.4) 



Notice that Xf(t n ) is normally distributed with mean zero and variance v n where 



t n 



tn 



<:=/ H z (t n ,s)f z (s)ds< H\t n ,s)ds- sup /». 

Jo JO s>0 

Using (|2.13[) and the fact that t n — > oo as n — ¥ oo, we have 



lim / H(t n ,s) ds ■ \ogt„ = 0, 

™^°°Jo 

Therefore 

lim sup v n log t„ < lim sup / H(t n , s) 2 ds ■ sup/ 2 (s) • logi„ = 0. (4.5) 

n— >oo n— >oc J Q s>0 

Since X n :— Xf(t n )/v n is a standardised normal random variable, we have that 

r \ x f(tn)\ r \X n \ 

hmsup —= — — = hmsup —== < 1, a.s., 

n->oo V2w„(logn) 1 /2 n ->cc \J2\ogn 

the last inequality being a routine consequence of the Borel-Cantelli lemma. Thus 
hmsup \X f (t n )\ = hmsup -M^L . ^(logn) 1 / 2 

n-^oo n-s-oo V Zv n (log n) 1 ' z 



< v^limsupv„(logi n ) 1/2 W^^ = 0, 
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due to P~21 and (l4"3j) . proving (g^J). 

STEP 2: Second term on the righthand side of (|4.3[) Next we show that 



lim sup 



Hoo(s)f(s) dB(s) 



= 0, a.s. 



(4.6) 



To do this, notice for every e > by Chebyshev's inequality and the Birkholder- 
Davis-Gundy inequality, c.f. e.g. (TQl Theorem 1.3.8, Theorem 1.7.3] that 



sup 

t„<t<t„ + i 



Hoo(s)f{s) dB(s) 



> e 



4 m 



sup 



Hoo(«)/(*) dB(s) 



H 00 (s)f(s)dB(s) 



H 2 oc ( S )f 2 (s)ds. 



Since iJoo e L 2 ([0, oo); R), and / G BC*([0, oo); K), we have 



sup 

t„<t<t n 



Hoo(s)f(s) dB(s) 



> e 



<- / Hl( S )f( S )ds. 
e Jo 



By the Borel-Cantelli Lemma, we have that (j4.6[) holds. 
STEP 3: Third term on the righthand side of g^]). 



lim U n = 0, a.s. 



where 



U n = sup 



H{s,s)f(s)dB{ S ) 



Note that (U n ) n >o is a sequence of independent random variables. 

Notice that on the interval [t n ,t n+ i], by the martingale time change theorem, 
there exists a Brownian motion B such that 



U„ = sup 



B„ [ / H z (s,s)f'(s)ds 



= sup \B n {r)\ 

0<t<J'1" + 1 H 2 (s,s)f 2 (s) ds 

< sup \B„{t)\. 

0<r<fl" + 1 H 2 (s,s) ds-su Pl ,> p(v) 

Therefore, with w n :— J t *" +1 H 2 {s, s) ds ■ sup 1J>0 f 2 {v), we have for some Brownian 
motion W that 

P[U n > e] < P[ sup |W(t)| > e]. 

0<T<tO„ 

Using the symmetry of the distribution function leads to the estimate 

F[U n >e]< 2P[\W(w n )\ > e] < 4P[W(w n ) > e] = 4F[Z > e/^UQ, 

where Z is a standard normal random variable, and we interpret the right hand 
side as zero if w„ = 0. Hence if $ is the distribution function of a standard normal 
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random variable and 

oo I 



j-Wi H 2 (s,s)ds / 



< +00, for all e > 0, 



we have that linin-^oo U n = 0, a.s. The sum is finite provided 



lim 

n— >oo 



H 2 (s, s) ds • logn = 0. 



Since H(t,t) 2 < c q (l + t 2q ), we have that 



/ H 2 (s,s)ds-logn<c q {1 + s 2q } ds ■ log 



so the right hand side is of the order n~ 1+e n 2qe logn = n - 1 +( 2c i+ 1 ) e logn — > as 
n — > 00, because < 1/(1 + 2q). 

STEP 4: Fourth term on the righthand side of (|4.3p . Finally, we show 
that 

(4.7) 

Z„ := / / //,(//.. s )/■(«) s) du. (4.8) 



lim Z„ = 0, a.s. 

n— >oo 



where 



By (|2.14l) there exists c q > such that 



/ Hf(t,s)ds< c q (l+t) 2q , t>0. 
Jo 



By P~2"j) . (9 < 1/(1 + q) < 1, so we can choose p g N so large that 2p[l-(l + g)0] > 1. 
Clearly for such a p £ N we have, via Jensen's inequality 

2p 



so there exists C p > such that 



t n 



Hi{u,s)f(s)dB(s)\ du 



i[tl<^(Wl-tr.) JH 

^CpSup/^^^+x-^) 2 ^ 1 



s>0 



H((u,s)f 2 (s)ds) du 



t n+ i / f« \P 

H 2 (u, s) ds I dit. 
/ 



Then 



< C p SU P / 2 P( S )(t„ +1 - in) 2 "" 1 / (C 9 (1+ M ) 2 «) P ^ 

s>0 Jt„ 

< C pC P q sup / 2 *> (a) • (t n+ i - t^- 1 f n+1 (1 + u) 2q P du 

S>Q Jt n 

< C pC r sup fP(s) ■ (t n+1 - t n ) 2 P(l + t n+1 ) 2q P. 

s>0 

Since t„ = n e , the right hand side is of the order [ n s-^ p n 2pqe = n -2p[i-(i+<?)0] as 
n — > 00. By Chebyshev's inequality, for any e > we have 

n\Z n \ >e]< ^nzl p ] < C^n-^-^+W, 

and because 2p[l — (1 + q)8] > 1, the righthand side is summable. Therefore, by 
the Borel-Cantelli lemma, we have (|4.7I) . 
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4.1. Proof of Examples. 

Proof of Example® Since H x is in L 2 ([0, oo); E), for each / G BC([0,oo);E) 
we have that the integral L H ao (s)f(s) dB(s) tends almost surely as t — >• oo to 
J °° H ao (s)f(s) dB(s). Thus 

t pOO 

H{t,s)f(s)dB(s)- H oc (s)f{s)dB(s) 
Jo 

r-t />oo 

= H*{t) f(s)dB(s)- H 00 (s)f(s)dB(s). (4.9) 







As H* obeys (gH| we have H*{t) -> as t -> oo. If / G L 2 ([0, oo); E), then 
Jq /(s) dB{s) tends to a finite limit a.s., and therefore both terms on the righthand 
side of (|4.9[) tend to zero as t — » oo a.s., and (|2.8|l holds. 

On the other hand, if / ^ £ 2 ([0, oo); E), then the martingale time change theorem 
and the Law of the Iterated Logarithm, c.f. e.g [HI Exercise 5.1.15] as well as the 
boundedness of / and (|2.11j) give that H$(t) J Q f(s) dB(s) — > as t — > oo a.s. Hence 
we have that (|2.8|) holds. 

We turn now to the question of relaxing (|2.1ip and still having (|2.8p holding. 
By virtue of the fact that obeys (|2 . 10[) . we have that (|2.5p holds. By the Law 
of the Iterated Logarithm, we have that 



limsup|^ t, (t)S(t)| < +oo, a.s. 

t— ►oo 



However, 



Iimsup|i3' 1, (i).B(f)| > lim sup \H*{n)B{n)\ = V21imsup \ B ( n )\ = ^ 

t-toc n^oc n^oc yj In log log(n + 2) 

a.s., by the discrete version of the Law of the iterated logarithm, cf. e.g. [3 
Theorem 10.2.1]. If f(t) = 1 for all t > in (gU), we have 



pt pOO pOO 

H(t,s)dB{s)~ H 00 {s)dB{s)=H\t)B{t)- H^dB 
Jo Jo Jt 



(s). 



The second term on the righthand side has zero limit as t — > oo a.s., but by the 
above argument, the first term obeys 

< limsup |£f B (i).B(i)| < +oo, a.s. 

t— >oo 

and therefore (|2.12[) holds, as claimed. □ 

Proof of Example® To show that it is sufficient, suppose / G BC([0, oo);E). 
Therefore, we have the identity 

t />oo 

H(t,s)f{s)dB(s)- / dB(a) 



(ff*(t)-l)/ H 00 (s)f(s)dB(s)- H 00 ( s )f(s)dB(s 



Since H^(t) — > 1 as t — > oo, the limit as t — > oo of the righthand side is zero, and 
so we have (|2.8p . Therefore, the condition H*{t) — > 1 as t — > oo is necessary and 
sufficient both for (EU) and for (1231). □ 
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Proof of Example^ Suppose that lim t _ i . 00 J t ' +1 c(s) 2 ds — 0. Then clearly one has 
c(s) 2 ds as n —¥ oo. Now, for n < t < n + 1, where n = \t\, 

V(s) 2 ds 

m+l 



t 



W{tf]=Y J / e- 2 (*- s )a(s) 2 ds+ / 

£V 2 < n -^ / cr(s) 2 <*s + / a(s) 2 ds. 

j—l Jj—i Jn 



< 

3- 



The first term on the right-hand side of the inequality is the convolution of a 
summable sequence with a sequence tending to zero and thus the convolution itself 
tends to zero as * — > oo. Thus we have lirut-^co 1E[V(*) 2 ] = 0. 
Conversely, suppose that lim^oo E[Y(t) 2 } — 0. Then defining 



y(t)=E[Y(t) 2 } = [ e-^a(s) 2 ds, 
Jo 

one obtains the identity 

rt+l ft+1 

y(t + 1) - y(t) = -2 J y(s)ds + J a(s) 2 ds. 

Thus, y(t) — > as t — > oo implies lim^oo J* +1 cr(s) 2 ds = 0. Hence J t * +1 a(s) 2 ds — > 
as * — > oo completely characterises the mean square convergence of Y to zero. 
We now show that lim^oo f* +1 <r(s) 2 ds ■ log* = L € (0, oo] implies that 

liminf / H(t,s) 2 ds ■ log * € (0, oo] (4.10) 
Observe, for n < t < n+ 1, 

j\- 2 ^-^a{s) 2 ds-\ogt^ ^>" 2 * jf e 2s a(s) 2 ds + j\- 2 ^a(s) 2 d^j log* 



>e" 4 



E;=u S ^ r T)j7l 1 ^) 2 ^-iog( J + i) 



e 2n /logn 

Standard application of Toeplitz's Lemma, [TH Lemma IV. 3.1], then gives (I4.10[) 



We show now that lim t J* +1 c(s) 2 ds ■ log* = implies that (|2.13[) holds. 



Observe that for n < * < n + 1, 



/ H(t, s) 2 ds ■log* = V / e- 2(t - s) cr(s) 2 dslog*+ / e" 2(t - 5 V(s) 2 dslogt 

JO j—^Jj—1 Jn 



3- 



< -^'"g^^- 1 ; a( S ) 2 d S log(n+l). 

e 2 »/log(n+l) y n 

Again, standard application of [TH Lemma IV. 3.1] gives the desired result. 

Observe that H\(t,s) = —H(t,s), thus with the supposition J* +1 a(s) 2 ds —> 0, 
this gives the first part of (|2.14[) . The remainder of (|2.14[) is clearly satisfied if 
lim t _ i . 00 cr(s) 2 log* = L G (0, oo). It is obvious that limt_j.oo o-{s) 2 log* = L G (0, oo) 
implies lim^oo J f ' +1 c(s) 2 ds ■ log* = L which hence violates (|2.13l) . □ 
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